Model Selection

Low-bit quantization

# Low-bit quantization

Midm 2.0 Base Instruct GGUF

Mi:dm 2.0 is a Korea-centered AI model developed by KT, which deeply internalizes the unique values and cognitive frameworks of Korean society and provides efficient text generation services.

Large Language Model

Transformers Supports Multiple Languages

Xlam 2 3b Fc R GGUF

The xLAM-2-3b-fc-r GGUF model is a text generation model generated based on a specific quantization method, focusing on function call, LLM agent, and tool usage scenarios.

Large Language Model

Transformers English

Featured Recommended AI Models

Qwen2.5 VL 7B Abliterated Caption It I1 GGUF

Quantized version of Qwen2.5-VL-7B-Abliterated-Caption-it, supporting multilingual image description tasks.

Transformers Supports Multiple Languages

Nunchaku Flux.1 Dev Colossus

The Nunchaku quantized version of the Colossus Project Flux, designed to generate high-quality images based on text prompts. This model minimizes performance loss while optimizing inference efficiency.

Image Generation English

Qwen2.5 VL 7B Abliterated Caption It GGUF

This is a static quantized version based on the Qwen2.5-VL-7B model, focusing on image captioning generation tasks and supporting multiple languages.

Transformers Supports Multiple Languages

Olmocr 7B 0725 FP8

olmOCR-7B-0725-FP8 is a document OCR model based on the Qwen2.5-VL-7B-Instruct model. It is fine-tuned using the olmOCR-mix-0225 dataset and then quantized to the FP8 version.

Transformers English

Lucy-128k is a model developed based on Qwen3-1.7B, focusing on proxy-based web search and lightweight browsing, and can run efficiently on mobile devices.

Large Language Model

Transformers English

AIbase

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

© 2025AIbase